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Settling  for  Less 


CMMI 


Do  these  statements  sound  familiar?  If  they  do,  your  organization  may  be 
settling  for  less  than  it  is  capable  of  and  may  be  a  good  candidate  for 
process  improvement. 

“I'd  rather  have  it  wrong  than  have  it  late.  We  can  always  fix  it  later.” 

-  a  senior  software  manager  (industry) 


“The  bottom  line  is  schedule.  My  promotions  and  raises  are  based  on 
meeting  schedule  first  and  foremost.” 

-  a  program  manager  (government) 
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Symptoms  of  Process  Failure 


CMMI 


Commitments  consistently  missed 

•  Late  delivery 

•  Last  minute  crunches 

•  Spiraling  costs 

No  management  visibility  into  progress 

•  You’re  always  being  surprised 

Quality  problems 

•  Too  much  rework 

•  Functions  do  not  work  correctly 

•  Customer  complaints  after  delivery 

Poor  morale 

•  People  frustrated 

•  Is  anyone  in  charge? 
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The  Process  Management 


CMMI 


The  quality  of  a  system  is  highly  influenced  by 
the  quality  of  the  process  used  to  acquire,  develop, 
and  maintain  it. 

This  premise  implies  a  focus  on  processes  as  well 
as  on  products. 

•  This  is  a  long-established  premise  in  manufacturing  (and  is  based  on  TQM 
principles  as  taught  by  Shewhart,  Juran,  Deming,  and  Humphrey). 

•  Belief  in  this  premise  is  visible  worldwide  in  quality  movements  in 
manufacturing  and  service  industries 

(e.g.,  ISO  standards). 
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Quality  Leverage  Points 
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While  process  is  often  described  as  a  node  of  the  process-people- 
technology  triad,  it  can  also  be  considered  the  “glue”  that  ties  the  triad 
together. 

Everyone  realizes  the 
importance  of  having  a 
motivated,  quality  work  force 
but  even  our  finest  people 
cannot  perform  at  their  best 

TECHNOLOGY  . 

when  the  process  is  not 
understood  or  operating  at  its 
best. 

Process,  people,  and  technology  are  the  major  determinants 
of  product  cost,  schedule,  and  quality. 
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Common  Misconceptions 
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I  don’t  need  process,  I  have 

•  really  good  people 

•  advanced  technology 

•  an  experienced  manager 
Process 

•  interferes  with  creativity 

•  equals  bureaucracy  +  regimentation 

•  isn’t  needed  when  building  prototypes 

•  is  only  useful  on  large  projects 

•  hinders  agility  in  fast-moving  markets 

•  costs  too  much 
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What  Is  a  Process  Model? 
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A  process  model  is  a  structured  collection  of  practices  that  describe  the 
characteristics  of  effective  processes. 

Practices  included  are  those  proven  by  experience  to  be  effective. 
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How  Is  a  Process  Model  Used? 
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A  process  model  is  used 

•  to  help  set  process  improvement  objectives  and  priorities 

•  to  help  ensure  stable,  capable,  and  mature  processes 

•  as  a  guide  for  improvement  of  project  and  organizational  processes 

•  with  an  appraisal  method  to  diagnose  the  state  of  an  organization’s  current 
practices 
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A  process  model  provides 

•  a  place  to  start  improving 

•  the  benefit  of  a  community’s  prior  experiences 

•  a  common  language  and  a  shared  vision 

•  a  framework  for  prioritizing  actions 

•  a  way  to  define  what  improvement  means  for  an  organization 
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CMMI  for  Process  Improvement  -1 


CMMI 


Use  CMMI  in  process  improvement  activities  as  a 

•  collection  of  best  practices 

•  framework  for  organizing  and  prioritizing  activities 

•  support  for  the  coordination  of  multi-disciplined  activities  that  might  be 
required  to  successfully  build  a  product 

•  means  to  emphasize  the  alignment  of  the  process  improvement  objectives 
with  organizational  business  objectives 

CMMI  incorporates  lessons  learned  from  use  of  the  SW-CMM®,  EIA-731, 
and  other  standards  and  models. 
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CMMI  for  Process  Improvement  -2 


CMMI 


A  CMMI  model  is  not  a  process. 

A  CMMI  model  describes  the  characteristics  of  effective 
processes. 


“All  models  are  wrong, 
but  some  are  useful.” 


George  Box 
(Quality  and  Statistics 
^Engineer) _ 
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The  CMMI  Framework 
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The  CMMI  Framework  is  the  structure  that  organizes  the  components 
used  in  generating  models,  training  materials,  and  appraisal  methods. 

The  CMMI  Product  Suite  is  the  full  collection  of  models,  training  materials, 
and  appraisal  methods  generated  from  the  CMMI  Framework. 

The  components  in  the  CMMI  Framework  are  organized  into  groupings, 
called  constellations,  which  facilitate  construction  of  approved  models. 

•  During  vl  .2  development,  CMMI-SE/SW/IPPD/SS  was  moved  to  the  CMMI 

for  Development  (CMMI-DEV)  constellation. 

•  Two  new  constellations  have  been  commissioned  by  CMMI  Steering 
Group: 

-  CMMI  for  Services  (CMMI-SVC) 

—  CMMI  for  Acquisition  (CMMI-ACQ) 
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Three  Complementary  Constellations 


CMML 


CMMI-DEV 

provides  guidance 
for  managing, 
measuring,  and 
monitoring 
development 
processes 


CMMI-SVC 

provides  guidance  for 
delivering  services 
within  organizations 
and  to  external 
customers 


CMMI-ACQ 

provides  guidance 
to  enable 
informed  and 
decisive 
acquisition 
leadership 
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Development  Constellation  Models 
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CMMI  for  Development  with  IPPD 
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Appraisal  Requirements  for  CMMI 
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The  Appraisal  Requirements  for  CMMI  (ARC)  defines  the  requirements 
considered  essential  to  appraisal  methods  intended  for  use  with  CMMI 
models: 

•  based  on  appraisal  principles  common  to  source  methods 

•  defines  three  classes  of  appraisal  methods  that  reflect  common  usage 
modes  of  appraisal  methods 

ARC  requirements  are  allocated  to  each  method  class  to  align  with  usage 
mode  characteristics. 
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ARC  Appraisal  Principles 


CMMI 


Start  with  an  appraisal  reference  model  (e.g.,  CMMI  for  Development). 

Use  a  formalized  appraisal  process  (e.g.,  SCAMPI  A). 

Involve  senior  management  as  the  appraisal  sponsor. 

Focus  the  appraisal  on  the  sponsor’s  business  objectives. 

Observe  strict  confidentiality  and  non-attribution  of  data. 

Approach  the  appraisal  collaboratively. 

Focus  on  follow-on  and  decision-making  activities  by  producing  actionable 
appraisal  results. 


— rain,  SEI  Presentation  (Full  Color) 

^==-  Software  Engineering  Institute  CamegieMellon  Author,  Date 

’ ’  ©  2007  Carnegie  Mellon  University 


SCAMPI  Family:  3  Classes  of  Appraisal 
Methods 
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SCAMPI  C  provides  a  wide  range 
of  options,  including  characterization  of 
planned  approaches  to  process 
implementation  according  to  a  scale 
defined  by  the  user. 

SCAMPI  B  provides  options  in  model 
scope  and  organizational  scope,  but 
characterization  of  practices  is  fixed  to 
one  scale  and  is  performed  on 
implemented  practices. 

SCAMPI  A  Is  the  most  rigorous  method, 
and  is  the  only  method  that  can  result  in 
ratings. 


breadth  of  tailoring 
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SCAMPI  Requirements 
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Requirement 

SCAMPI  A 

SCAMPI  B 

SCAMPI  C 

Types  of  Objective 
Evidence  Gathered 

Documents  and 
interviews 

Documents 
and  interviews 

Documents  or 
interviews 

Ratings  Generated 

Goal  ratings 
required 

No  ratings 
allowed 

No  ratings 
allowed 

Organizational  Unit 
Coverage 

Required 

Not  required 

Not  required 

Minimum  Team  Size 

4 

2 

1 

Appraisal  Team  Leader 
Requirements 

SCAMPI  A  lead 
appraiser 

SCAMPI  B 
and  C  team 
leader 

SCAMPI  B  and 

C  team  leader 
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Training  for  CMMI 


CMMI 


Introduction 
to  CMMI 


SCAMPI  Lead 
AppraiserSM  Training 


SCAMPISM  B  and  C 
Team  Leader 
Training 


CMMI  Instructor 
Training 
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Benefits  Information 


CMMI 


Information  about  CMMI  benefits  is  available  on  the  CMMI  Performance 
Results  Web  site  and  in  the  July  2006  SEI  technical  report,  Performance 
Results  of  CMMI-Based  Process  Improvement  (CMU/SEI-2006-TR-004). 

•  This  report  is  based  on  public  reports,  interviews,  supplementary  materials, 
and  comprehensive  literature  review  and  is  available  on  the  SEI  Web  site  at 
http://www.sei.cmu.edu/publications/documents/06.reports/06tr004.html. 

•  The  following  three  slides  are  adapted  from  this  technical  report. 

•  For  more  information,  see  the  CMMI  Performance  Results  Web  site  at 
http://www.sei.cmu.edu/cmmi/results.html. 
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Performance  Measures  -  CMMI 


CMMI 


The  performance  results  in  the  following  table  are  from  30  different 
organizations  that  achieved  percentage  change  in  one  or  more  of  the  six 
categories  of  performance  measures  below. 


Performance  Category 

Median  Improvement 

Cost 

34% 

Schedule 

50% 

Productivity 

61% 

Quality 

48% 

Customer  Satisfaction 

14% 

Return  on  Investment 

4:1 
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Example 


CMMI 


The  organization  3HT,  with  a  little  over  2  years  of  CMMI-based  process 
improvement,  showed  significant  improvement  in  average  number  of 
defects  found. 


Average  Number  of  Defects  found  in  IV&V  Before  and 
After  Implementation  of  Quality  Control  Procedures 
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Example 


CMMI 


it  -2 


The  Software  Maintenance  Group  at  Warner  Robins  Air  Logistics  Center,  a 
maturity  level  5  organization,  significantly  reduced  schedule  variance. 
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Some  of  the  Organizations  Using  CMMI 


CMMI 


Accenture 

Boeing 

Dyncorp 

FAA 

General  Dynamics 

Honeywell 

Intel 

L3  Communications 

NASA 

Nokia 

Polaris 

SAIC 

Tata  Consultancy  Services 

U.S.  Army 

Wipro 


Bank  of  America 

Bosch 

EDS 

Fannie  Mae 
General  Motors 
IBM  Global  Services 
J.  P.  Morgan 
Lockheed  Martin 
NDIA 

Northrop  Grumman 

Raytheon 

Samsung 

TRW 

U.S.  Navy 

Zurich  Financial  Services 


BMW 

Ericsson 

Fujitsu 

Hitachi 

Infosys 

KPMG 

Motorola 

NEC 

NRO 

NTT  DATA 
Reuters 

Social  Security  Administration 

U.S.  Air  Force 

U.S.  Treasury  Department 
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SEI  Partners  are  licensed  by  the  SEI  to  provide  appraisal  services  and/or 
training  services. 

•  There  are  226  SEI  Partners  that  offer  the  Introduction  to  CMMI  training 
course. 

•  There  are  248  SEI  Partners  that  offer  SCAMPI  appraisal  services. 

Instructors  and  appraisers  are  authorized  by  the  SEI.  There  are  currently 
385  SEI-authorized  Introduction  to  CMMI  VI.  1  Instructors  and  436  SEI- 
authorized  Lead  Appraisers. 

Since  the  release  of  CMMI  in  2000,  there  have  been  many  people  trained 
in  CMMI: 

•  Introduction  to  CMMI:  54,460 
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CMMI  Appraisals 


CMMI 


The  following  data  shows  the  number  of  SCAMPI  VI  .1  Class  A  appraisals 
that  were  conducted  since  the  April  2002  release  through  June  2006  and 
reported  to  the  SEI  by  July  2006: 


1,581 

appraisals 

1,377 

organizations 

840 

participating  companies 

169 

reappraised  organizations 

6,001 

projects 

63.8% 

non-USA  organizations 
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CMMI 


Process  Maturity  Profile  by  All  Reporting 
Organizations  (as  of  6/30/06) 
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Reporting  Organizational  Categories 
(as  of  6/30/06) 


CMMI 


Commercial/In-house 


67.6% 


Contractor  for 
Military/Government 


28.8% 


Military/Government 

Agency 
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The  Bottom  Line  cmmi 


Process  improvement 

should  be  done  to  help  the  business — 

not  for  its  own  soke 
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CMMI  Can  Benefit  You 


CMMI 


CMMI  provides 

•  guidance  for  efficient,  effective  improvement  across  multiple  process 
disciplines  in  an  organization 

•  improvements  to  best  practices  incorporated  from  the  earlier  models 

•  a  common,  integrated  vision  of  improvement  for  all  elements  of  an 
organization 
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CMMI  Benefits 


CMMI 


CMMI-based  process  improvement  benefits  include 

•  improved  schedule  and  budget  predictability 

•  improved  cycle  time 

•  increased  productivity 

•  improved  quality  (as  measured  by  defects) 

•  increased  customer  satisfaction 

•  improved  employee  morale 

•  increased  return  on  investment 

•  decreased  cost  of  quality 
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Improve  Your  Bottom  Line 


CMMI 


Improvement  means  different  things  to  different  organizations. 

•  What  are  your  business  goals? 

•  How  do  you  measure  progress? 

Improvement  is  a  long-term,  strategic  effort. 

•  What  is  the  expected  impact  on 
the  bottom  line? 

•  How  will  impact  be  measured? 
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For  More  Information  About  CMMI 


CMMI 


Go  to  CMMI  Web  site: 

•  http://www.sei.cmu.edu/cmmi 

•  http://seir.sei.cmu.edu 


Contact  SEI  Customer  Relations: 

•  Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 
FAX:  (412)268-5800 

•  customer-relations@sei.cmu.edu 
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